114 research outputs found
Local Clustering in Contextual Multi-Armed Bandits
We study identifying user clusters in contextual multi-armed bandits (MAB).
Contextual MAB is an effective tool for many real applications, such as content
recommendation and online advertisement. In practice, user dependency plays an
essential role in the user's actions, and thus the rewards. Clustering similar
users can improve the quality of reward estimation, which in turn leads to more
effective content recommendation and targeted advertising. Different from
traditional clustering settings, we cluster users based on the unknown bandit
parameters, which will be estimated incrementally. In particular, we define the
problem of cluster detection in contextual MAB, and propose a bandit algorithm,
LOCB, embedded with local clustering procedure. And, we provide theoretical
analysis about LOCB in terms of the correctness and efficiency of clustering
and its regret bound. Finally, we evaluate the proposed algorithm from various
aspects, which outperforms state-of-the-art baselines.Comment: 12 page
DPPIN: A Biological Dataset of Dynamic Protein-Protein Interaction Networks
Nowadays, many network representation learning algorithms and downstream
network mining tasks have already paid attention to dynamic networks or
temporal networks, which are more suitable for real-world complex scenarios by
modeling evolving patterns and temporal dependencies between node interactions.
Moreover, representing and mining temporal networks have a wide range of
applications, such as fraud detection, social network analysis, and drug
discovery. To contribute to the network representation learning and network
mining research community, in this paper, we generate a new biological dataset
of dynamic protein-protein interaction networks (i.e., DPPIN), which consists
of twelve dynamic protein-level interaction networks of yeast cells at
different scales. We first introduce the generation process of DPPIN. To
demonstrate the value of our published dataset DPPIN, we then list the
potential applications that would be benefited. Furthermore, we design dynamic
local clustering, dynamic spectral clustering, dynamic subgraph matching,
dynamic node classification, and dynamic graph classification experiments,
where DPPIN indicates future research opportunities for some tasks by
presenting challenges on state-of-the-art baseline algorithms. Finally, we
identify future directions for improving this dataset utility and welcome
inputs from the community. All resources of this work are deployed and publicly
available at https://github.com/DongqiFu/DPPIN
Graph Neural Bandits
Contextual bandits algorithms aim to choose the optimal arm with the highest
reward out of a set of candidates based on the contextual information. Various
bandit algorithms have been applied to real-world applications due to their
ability of tackling the exploitation-exploration dilemma. Motivated by online
recommendation scenarios, in this paper, we propose a framework named Graph
Neural Bandits (GNB) to leverage the collaborative nature among users empowered
by graph neural networks (GNNs). Instead of estimating rigid user clusters as
in existing works, we model the "fine-grained" collaborative effects through
estimated user graphs in terms of exploitation and exploration respectively.
Then, to refine the recommendation strategy, we utilize separate GNN-based
models on estimated user graphs for exploitation and adaptive exploration.
Theoretical analysis and experimental results on multiple real data sets in
comparison with state-of-the-art baselines are provided to demonstrate the
effectiveness of our proposed framework.Comment: Accepted to SIGKDD 202
- …